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1.  INTRODUCTION 


Segmentation  and  boundary  detection  algorithms  are  basic  tools  for  extracting  global 
features  out  of  digitized  data.  Techniques  based  on  variational  methods  achieve  the  result 
(a  segmented  image)  by  minimizing  a  cost  functional.  In  1985,  Mumford  and  Shah 
introduced  a  mathematical  model  that  captures  the  essential  features  that  must  be 
considered  when  solving  the  segmentation  problem  (Reference  1).  It  is  a  multi-scale 
teclmique  that  allows  the  extraction  of  features  at  different  levels  of  detail  (scale).  It  is 
also  a  multichannel  technique  that  can  be  used  to  segment  images  of  a  scene  when 
registered  multiple  data  channels  for  the  same  scene  are  available.  These  may  be  data 
channels  from  various  sensors,  hue  channels,  preprocessing  channels  such  as  wavelet  or 
other  transform  channels,  etc. 

The  Mumford  &  Shah  {M&S )  Functional  (References  1  and  2)  has  the  form 

E{u,K)^a^  \\\u-g{d^+  \\Vufdfi  +  X-£{K),  (1.1) 


where  Q  denotes  a  "rectangle"  in  R‘' ,  c?  e {1,2,3,- denotes  the  "image" 
(g  is  //-measurable),  c  =  number  of  "channels",  c  €{1,2,3,- ••},  and  u  \Q.-^R‘  is  an 
approximation  to  g  belonging  to  a  set  of  functions  <t>.  The  rectangle  Q  is  decomposed 
into  a  finite  collection  of  disjoint  open  sets  0„  (n  =1,2,  ...,  N)  and  their  boundaries 


/Y 

AT  =  (J  ^0„ ;  so  that  Q  = 


H=1 


[Jo.. 


uAT,  and  K  is  sufficiently  nice  to  have  a  "length". 


denoted  by  £(K) .  The  disjoint  open  sets  (n  =  1,  2,  N)  and  their  boundaries 
together  with  u  are  called  a  segmentation  of  (Cl,  g). 

»=i 
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The  goal  is  to  construct  2  things: 

(a)  A  smoothed  ideal  image,  m  :  Q  i?' . 

(b)  A  set  of  boundaries,  K  (z  Q  ; 

u  and  K  are  found  by  minimizing  the  functional  E. 

The  first  term  on  the  right  hand  side  (RHS)  of  Equation  1.1  ensures  that  m  is  a 
faithful  representation  of  g,  the  second  term  ensures  that  m  is  as  smooth  as  possible  on 
each  open  set  0„ ,  and  the  last  term  prevents  the  boundaries  from  growing  too  large.  The 
parameters  a  and  A  are  weighting  factors  that  control  the  quality  of  the  approximation 
and  the  coarseness  of  the  segmentation. 

The  Weak  Continuity  Constraint  models  of  Blake  and  Zisserman  are  another 
collection  of  effective  techniques  for  segmentation,  boundary  detection,  and  smoothing  of 
data  (Reference  3).  In  particular,  the  weak  string  constraint  and  the  weak  membrane 
constraint  can  be  considered  to  be  the  discrete  forms  of  the  M&S  functional  in 
dimensions  1  and  2,  respectively.  Blake  and  Zisserman  developed  a  technique  called 
Graduated  Non-Convexity  (GNC)  (Reference  3)  that  can  be  used  to  minimize  the  discrete 
M&S  functional. 

The  GNC  method  relies  on  a  homotopy  between  the  cost  functional  and  a  convex 
approximation  to  it.  The  minimum  of  the  convex  approximation  is  easily  found.  The 
convex  functional  is  gradually  deformed  via  the  homotopy  until  it  converges  to  the 
original  functional.  At  each  step  in  the  gradual  deformation  a  minimization  is  performed. 
The  collection  of  minimal  points  so  obtained  forms  a  path  that  leads  to  a  minimum  of  the 
original  functional.  However,  this  technique  was  developed  only  for  single  chaimel  data. 

In  this  paper  we  extend  the  GNC  method  to  the  multichannel  setting  (that  is,  vector 
valued  data).  We  develop  the  mathematical  foundation  for  the  technique  in  the 
multichannel  setting.  The  most  important  technical  issue  of  this  method  is  the  convex 
approximation:  whether  it  exists  and  how  it  is  obtained.  In  the  multichannel  setting,  in 
dimensions  1,  2,  and  higher,  determining  if  the  convex  approximation  exists,  as  well  as 
the  specific  details  of  how  to  obtain  it,  are  the  problems  to  be  resolved. 
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A  summary  of  the  theory  behind  the  GNC  method  in  the  multichannel  setting  for 
dimensions  1  and  2  will  be  presented  here  as  a  collection  of  definitions  and  propositions 
with  proofs.  The  results  for  dimension  d>3  will  be  stated  here  without  a  proof  The 
proof  follows  the  same  steps  as  the  proofs  for  J  =  1 , 2. 

Section  2  contains  an  outline  of  the  GNC  method.  Section  3  contains  a  complete 
summary  of  the  multichannel  theory  for  dimension  1  in  the  form  of  a  series  of 
propositions  that  lead  to  the  convexity  result,  Proposition  3.8.  In  Section  4  we  present  the 
theory  for  dimension  2  in  the  same  form,  leading  to  Proposition  4.4. 


2.  THE  GRADUATED  NON-CONVEXITY  METHOD 


For  completeness  and  to  introduce  the  reader  to  the  GNC  method,  the  idea  behind  the 
method  is  briefly  described  in  this  section  in  the  one-dimensional,  single  channel  setting 
(see  Reference  3  for  more  details). 

The  Discrete  Mumford  &  Shah  Functional  for  one-dimensional  and  single  channel 
data  x  =  [XpX2,...,x^]^  has  the  form 


A^-1 


E{u,a)  =  - Xif  +  ^ - M,f  (1  -a,)  +  ’ 

1=1  /=1  /=1 


(2.1) 


where  u  =  ,  a  =  [a^,a^,...,af^f ,  a,  e{0,l}  Vi,  and  X  and  a  are 

positive  weights.  This  is  called  The  Weak  String  Constraint  in  Reference  3. 

The  three  terms  on  the  RHS  of  Equation  2.1  play,  respectively,  the  same  roles  as  the 
three  terms  on  the  RHS  of  Equation  1.1.  Here,  x  plays  the  role  of  g. 
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We  seek  a  vector  u  that  is  smooth  and  is  close  to  x.  The  vector  u  is  found  by 
minimizing  Equation  2.1  with  respect  to  u  and  the  Boolean  variable  a. 

The  minimization  with  respect  to  a  can  be  done  analytically  (Reference  3),  as 
follows.  k 

Elimination  of  the  Boolean  Variables 

LeXh-.R^  {0,1}  ->  7?  be  given  by  h{t,b)  =  (\-b)  +  ab  (tsR,b€  {0,1}) ,  and  let 

g-.R-^R  be  given  by 


jA't'  ifH<^ 

[a  if|r|>'%. 


Note  that,  by  putting  the  last  two  summations  in  one,  E  can  be  written  in  terms  of  has: 


N 

Eiu,a)  =  ^(m,.  - X,.)'  • 

/=! 


E 

/=1 


(2.2) 


Moreover,  since  g( t)  =  min  h(t ,b)  ^/teR,  it  follows  that,  for  each  ugR^,  the 

*€{0,1} 

minimum  of  E  over  a  is  given  by 


N  N-\ 

](M/  -Xif  + 

/=rl  /=! 


Theorem  2.1  min  E(u,a)  =  F(u)  Vw  €  7?*^ . 

aeiO.l}" 


6 


NAWCWD  TP  8349 


The  Convex  Approximation  F;^^ 

The  function  F  is  non-convex.  As  noted  above,  the  GNC  method  consists  of 
approximating  F  with  a  convex  function  F^^^  and  obtaining  a  homotopy  between 

and  F.  The  minimum  of  the  convex  approximation  is  easily  found  (e.g.,  by  steepest 

descent).  The  convex  function  is  gradually  deformed  via  the  homotopy  until  it  converges 
to  the  original  function.  At  each  step  in  the  gradual  deformation,  a  minimization  is 
performed;  the  starting  point  in  the  minimization  procedure  is  the  minimum  of  the 
previous  function.  The  collection  of  minimal  points  so  obtained  defines  a  path  that  leads 
to  a  minimum  of  F. 

The  homotopy  is  defined  in  terms  of  a  collection  of  functions  F^  (0<yo<y<oo), 
such  that  F^  F  uniformly  as  y  oo . 

The  functions  F^  are  given  by  (2.3)  with  g  replaced  hy  g^  :  R  R  defined  by 


a 


if  |/|  <  q 
if  ^  <  |/|  <  r 
if  r  <  |/| 


(  y  >  0 ),  with 


q  =  -^  and  r  =a(-  +  ^). 
X  r  Y  X 


Remark  2.1.  ->  g  uniformly  as  y  ^  oo . 

The  GNC  theory  consists  of  showing  that  there  exists  a  positive  value  of  y 

y 

(Y  =Yo  =  1  / 2)  for  which  F^  is  convex.  By  letting  yiO  =  ~  (0  <  t  <  1),  one  obtains 
the  desired  homotopy  H :  i?  ^  x  [0,1]  ->  [0,co) . 


J  F(m)  for  t  =  0,uGR^ 
|f,(,)(«)  for  fe(0,l],«eJ?^. 
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Remark  2.2.  Since  F  uniformly  as  y  oo  and  (u)  varies  continuously  with 

X  and  u,  the  function  H  is  continuous  on  x[0,l]  and,  therefore,  it  defines  a 
homotopy  between  F  and  . 

In  this  paper  we  present  the  generalization  of  this  theory  to  the  multichannel  setting  in 
dimensions  1  and  2.  The  extension  to  dimensions  3  and  higher  follows  the  development 
of  the  theory  in  dimension  2  in  Section  4.  The  value  of  y  for  which  F^  is  convex 

satisfies  y  =  27,  where  d  =  1,  2,  3, ...  is  the  dimension  of  Q . 

In  the  multichannel  setting,  each  x^.  and  each  w,  are  vectors  of  dimension  c,  where  c 
is  the  number  of  channels.  The  obvious  thing  to  do  is  to  introduce  a  vector  norm 
(Euclidean  Norm)  in  Equations  2.1  and  2.3,  as  in  the  M&S  functional.  This  leads  to  the 
one-dimensional  c-channel  model 


E(u,a) 


W;  -X; 


/=] 


+ Z  "  “<•  11^  } 

/=! 


and 


/=1 


with  M  —  [U|  ,1^2  ^ ^k,2’  sF 

a  =  [a^,a2,---,a^]'  e{0,l}^. 


(l<k<N),  and 


The  theory  follows  the  same  steps  outlined  above.  The  greatest  challenge  was  to 
establish  convexity  in  the  presence  of  the  vector  norm  instead  of  a  scalar  absolute  value. 
The  theory  does  go  through  even  in  the  presence  of  a  weighted  vector  norm.  It  becomes 
evident  that  the  value  of  y  for  which  F^  is  convex  must  satisfy 
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j  =  2  •  {number  of  terms  in  G)  and  that  the  dimension  d  =  {number  of  terms  in  G) .  Thus, 

in  general,  =  — ,  where  d  =  1,  2,  3,  ...  is  the  dimension  of  the  domain  Q .  (G  is 
2d 

defined  in  Definition  3.10,  with  1=  N  d=\  and  in  Definition  4.5  for  d  -  2,)* 

We  now  present  a  collection  of  definitions  that  constitute  the  generalization  of  the 
GNC  method  to  the  multichannel  setting  in  dimension  d=\. 


3.  THE  ID-MULTICHANNEL  GNC  CASE 


3.1.  DEFINITIONS 


if  \t\<'^/x 

3.1.  g  :R->  R  is  given  by  g(t)  =  <  ,  for  a  >  0 . 

[or  ifH>^ 

if  |r|  <  q 

3.2.  g^:R-^R  isgivenby  gy(,t)  =  ' cc-\y(\t\-rY  if^<|fl<r  (r>0), 

a  if  r  <  |f| 

a  j  2  1  . 

with  q  =  and  r  =  a{—  +  -^r) . 

AV  V 


3.3.  g*:R-^R  isgivenby  g*it)  =  --^yf  (t^R)- 


3.4.  h\Rx{0,\}->R  isgivenby  h(t  ,b)  =  t^  -  b)  +  ocb  (t  e  R,b  €{0,\})  • 


3.5.  c  denotes  the  number  of  channels  per  pixel;  N  denotes  the  number  of  pixels. 


3.6.  D-.R^^'  R  is  given  by  D{u)  =  -  x^\\^  , 
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where  w*2  (k -l,2,--' ,  N) ,  m  =  [m,  rwj  ]  ei?  , 

W  =  <i/ag(w,,W2,-",Wc)  >  0) ,  and  the  weighted  norm  ||  -> [0,oo)  is  defined 

as  • 

/=1 

3.7.  is  defined  as  T* (w)  =  «*+,- m*  for  A:  =  1, 2, ••• ,  A^-1  and  for 

A  =  //,  Lf^{u)  =  u^-Ufj  {u  =  {u^^\u2\---:u/\^  eR'^‘). 

3.8.  G:R^^x  {0,1} ^  is  given  by  G{u,a)  ^  ^ h(\\L^  (m)1L ) ,  with  e<N,u 

k=\ 

as  in  3.6,  and  a  =  [a,  a2  '"^n^ 

3.9.  F :  R'^‘ X  R  is  given  by  F  =  D  +  G. 

3.10.  G:R'^‘'->R  isgivenby  G(u)  =  '^g(lL^(u)\\^)  {u  eR'^‘') ,  £<  N . 

*=i 

3.11.  Gy  and  G^  :  R’^"  R  are  defined  as  G  with  g  replaced  by  g^  and  g\ 

respectively. 

3.12.  F,  Fy,  and  F* :  R'^‘-' R  are  defined,  respectively,  as  F  =  D  +  G, 
F^=D  +  G^,  and  =Z)  +  G\ 

3.2.  CONVEXITY  OF  Fy  :  R 

Proposition  3.1.  Suppose  f-.R-^R,  f  and  /’  are  continuous,  /"  is  piecewise 
continuous,  and  /  >  0 .  Then,  /  is  convex. 

Proposition  3.2.  If  g  =  (gy  -  g*) :  R  —>  R ,  then 

(a)  g  and  g  are  continuous  and  g  (t)>0  \/t>0 . 

(b)  g"  is  piecewise  continuous  and  g  (t)>0  Vt . 
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Corollary  3.1.  g  =  (gy  -  g*)'-  R  is  convex  (by  Propositions  3.1  and  3.2). 

Proposition  3.3.  If  f :  R"  -)■  R  is  convex  and  L :  R”'  R"  is  linear,  then  f  o  L  is 
convex. 

Proposition  3.4.  If  f:R-^R  is  convex  and  non-decreasing  for  />0  then, 
/  o  ||.||^  :R"^R  is  convex. 

Corollary  3.2.  g  °|||^  :  R^"  ^  R  is  convex  (by  Corollary  3.1  and  Propositions  3.2  and 
3.4). 

Corollary  3.3.  g  o  :  R^‘'  ->  R  is  convex  Wk  =  1,2,...,.^  (by  Proposition  3.3  and 
Corollary  3.2). 

Corollary  3.4.  -  F*  :  R^'^"  R  is  convex  (because  it  is  a  sum  of  functions  of  the 

form  g  o  IIj^  o  Li^  ,  which  are  convex  by  Corollary  3.3). 

_  i 

Proposition  3.5.  The  Hessian  D^F*  satisfies  D^F*  =  2-IF W  DL^ ,  where 

A:=l 

the  constant  matrix  DL^  denotes  the  total  derivative  of  = 

W  s  Block  diag(W,W, ■••,}¥) ,  and  W  =  diag(w^,W2,---,w^) . 

^  '  '  V 

N -times 


Proposition  3.6.  The  Hessian  is  positive  semidefmite  for  y  small  enough. 

Corollary  3.5.  F*  '.R^"  R  is  convex  for  y  small  enough  (because  for  y  small 
enough  D^F*  is  positive  seniidefmite  and  continuous). 

Corollary  3.6.  F^  :  R^'"  R  is  convex  for  y  small  enough  (because  by  Corollaries  3.4 
and  3.5,  F^  =  (F^  -  F"^)  +  F*  is  a  sum  of  convex  functions  for  y  small  enough). 

Proposition  3.7.  If  ->  F*"  are  given  by  Definition  3.7,  then 
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=w'^k^awY 

where  A  is  an  Ncx  Nc  "block  circulant"  matrix  with  blocks  of  size  c  x  c : 

-I  I  0  .  0 

0  -I  I  0  0 

:  0 

0  .  0  -I  I 

I  0  .  0  -I 

Proposition  3.8.  If  l  =  N,  I*  :  ->  R‘  are  given  by  Definition  3.7,  and  y  =  K » then 

Y  satisfies  Proposition  3.6,  and  Corollaries  3.5  and  3.6. 

3.3.  THE  PROOFS 
Proof  of  Proposition  3.1 

Since  /  >  0  and  is  piecewise  continuous,  the  following  holds  for  s  <t 

.V  '■='  x,.,  '■=> 

where  s  =  <■•■  <  x„  =  t  and  the  set  {x, :  /  =  0, 1,  •  •  • , «}  contains  the  points  of 

discontinuity  of  /  '  inside  the  interval  [jt,/].  But  /’  is  continuous,  so  f  \xj)  =  f  \x.) 

t 

for  all  i.  Consequently  J/"(x)tA:  =  f  \t)- /'(5)>0  for  all  s<t.  This  result  and  the 

.y 

fact  that  /  is  continuous  lead  to  the  following  two  conclusions: 
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If  x<:)/  then  f{y)-f{x)  =  ]f\t)dt>\f\x)dt  =  f\x)[y-x\. 

X  X 


X  X 

If  x>:v  then  f{x)-f{y)  =  \f\t)dt<\f\x)dt  =  f\x)[x~y]. 

y  y 

The  two  inequalities  above  imply  /(>')  ^ /(jc)  +  /  (x)[>' - x]  for  all  x,yeR. 
Therefore,  /  is  convex  by  Reference  4,  Proposition  4,  page  178. 


Proof  of  Proposition  3.2 

(a)  Since  g  =  gy-g^  and  g*  e  C” ,  we  must  show  that  g^  and  gj,  are  continuous. 
The  even  function  g^  is  continuous  on  R  if  it  is  continuous  on  [0,oo) ,  which  it  clearly  is, 
except  possibly  at  q  and  r .  Continuity  of  gy  at  q  is  established  by  showing  that 
-rY  at  t  =  q.  Elementary  manipulations  verify  the  above  identity. 
Continuity  of  gy  at  r  is  established  by  showing  that  a  =  a-\y{t -r)^  at  t  =  r,  which 
is  obvious.  Thus,  g  is  continuous. 

Next,  differentiate  g^ . 


gAO  =  \ 


2Xf 

rir-t) 

-rir+t) 

0 


if|i|<9 
\iq<t  <r 
if  -r  <t  <-q 
if|/|>r. 


(3.3.1) 


Since  gy  is  an  odd  function,  it  suffices  to  establish  continuity  at  q  and  r .  Continuity  at 
r  is  established  by  showing  that  y{r  -t)  =  0  at  t  =  r,  which  is  obvious.  Continuity  at  q 
is  established  by  showing  that  22? t  =  y{r  -t)  at  t  =  q .  Simple  algebra  and  the  fact  that 
/--  =  a(j  +  y)  and  q  =  verifies  the  above  identity.  Thus,  g  is  continuous. 
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That  g  (t)  >  0  for  /  >  0  is  clear  from  Equation  3.3.1  and  the  fact  that  (g^)  (0  -  -yt 
{t  eR). 


(b)  Differentiating  Equation  3.3.1  yields 


-r 

0 


if  H 

if  ^  <  |/|  <  r 
if  \t\  >  r. 


Since  (g^ ) "  (0  =  -/  (t  eR),  we  have 


+y  if|/|<^ 


f'(0  =  i 


0 

r 


if^  <|/|  <r 
if|r|>r. 


Thus,  g  is  piecewise  continuous  and  g  (/)  >  0  for  all  t . 


Proof  of  Proposition  3.3 

Choose  e  /?"'  and  0  <  r  <  1 .  Then,  since  L  is  linear  and  /  is  convex  we  have 


/  o  I((l  -  t)x  +  ty)  =  /((I  - 1) Lx  +  tLy))  < 

(1-0/ +  tfiLy)  =  (1  -  0  •  /  °  +  ^  •  /  °  -^(t)  ■ 


Thus,  the  composition  /  o  Z  is  convex. 


Proof  of  Proposition  3.4 
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Set  a  =  \\(l-t)x  +  ty\\^  and  b  =  (1  -  t)\\x\\^  +  t\\y\\^ ,  (x,y  eR",t  e[0,l]). 
Since  0<a<b  and  /  is  non-decreasing  for  t  >  0  and  convex, 


f(a)  <  f(b)  <  (1  -  0  •  /(||x||^)  + 1  ■  /(IHL) . 


Thus,  /  o|||jj,  :R"  R  is  convex. 


Proof  of  Proposition  3.5 

Recall  that  F*=D+G\  C{lt)  -  JiK -x.t ,  G*(tt)  =  i;g*(||i.(")IL). 

A=1  k=\ 

yt  =  l,2,3,-",A^.So, 


^{u) 

dUy 


N  c 


Jk-1  ///=) 


W,«  =  2Wj  (Uy  -Xy)  => 


Jo  if  rs^  if 
|2wy  if  rs  =  if’ 


(1  <  r,i  <  A^,  1  <  s,j  <  c) . 


Thus,  the  Hessian  D^D  of  D  satisfies  D^Z)  =  2  •  fT ,  where 
W  =  Block  diagfW  ,W  ,W)  is  an  NcxNc  -  matrixwith  W  =  diag(w^,W2,^^^,w^). 

' - V  ' 

N -times 


Next,  we  compute  the  Hessian  of  G^.  For  this  we  need  the  partial  derivatives 

of  the  compositions  g^oL,^,  where  g*  denotes  the  composition  g*o|l|^;  that  is. 
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r(x)  =  g'dWD  =  -ir\\4l  = 

/=! 

{u  e 


Let  Vg*(t)  denote  the  gradient  of  g*  :  R  evaluated  at  t  eR‘  and  let  DL^ 

denote  the  total  derivative  of  L,:R‘'^  -^R‘  (\<k<  £).  If  /  =  [t,  •  •  •  tj'  e  R^ ,  then 


Note  that  Vg* (t)  is  a  1  x  c  -  matrix  and  DZ,*  is  a  cxNc-  matrix.  Since  4  is  linear, 
DLf^  is  a  constant  matrix  (1  <  A:  <  £). 

The  gradient  of  the  composition  g*  o  4  is  obtained  using  the  chain  rule: 


V(r»i.X“)=fvr,_,  ,  J  oi.  .  (3-3-2) 

V  t  -  Lf^  {U)  J 

Since,  by  definition,  V(g*  o  4 )(m)  =  g* (4 (“))» (4 (“))’  (4 (“))]  ’ 

it  follows  from  Equation  3.3.2  that 
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Zi  dt„,  du. 


\<k<l). 


dg* 

Similarly,  since  - :  R‘'  R, 

dt... 


V 


j  tt 


(3.3.3) 


where  {ueR^\  {r,s)  e  {(1,1),  (1,2),  -  (A,c)} ,  1  <  A:  <  £). 


S  „+,  d  ~+/r  t  w  ^ ^  ^  ,  .  3L 


Finally,  ^G^(«)  -  (4(«))  =  I;E-^(4(«))-^  and,  since 

k=\ 


km 


dUy 


k^\  w=l  ^*w 


dUy 


dU,: 


^  d 

IS  a  constant,  - G  (w)  =  > ,  /  — — 

du^du, 


rs'' 


fT 

dt... 


{LM) 


dL 


km 


dUy 


Applying  Equation  3.3.3  leads  to 


^  ^4.  ^  S  'S^  ^ g*  j 

du„  duy 


k=\  /«=1  M=1 


,  (uei?^*",  (r,s)  and 


(ij)  €{(l,l),(l,2),-(Ar,c)}). 


Next,  since 
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dt„. 


{t)  =  -Y-wJ„„ 


(r  =  [r,  ^2  -"tcf  ei?%  l<m<c), 


{t)  =  -yw„,-5„ 


(-r-w„,  i{n  =  m 
[0  ifn^  m. 


Hence, 


G*(“)  =  Z  E -r 


A*l  ///=! 


du^  dUy  ’ 


where  {ueR'^\  (r,s)  and  {i,j)  e  {(1,1),  (1,2),  •••  (iV,c)} ),  which  implies  that 


D^G^=-r -1(04)^04. 

^=1 


Adding  D^D  and  completes  the  proof. 


Proof  of  Proposition  3.6 

It  will  be  shown  that,  for  y  small  enough,  u^D^F^u  >0  Vm  e  .  The  norm  of  the 
linear  mappings  ^  R‘'  will  be  instrumental.  These  norms  are  defined  as 


NAWCWD  TP  8349 


where  ||w||^  =  Wu  =  ^  ||^  and  ||^  =  ul  Wu^ ,  (k  =  \,2,--- ,  N)  (see  Definition 

3.6). 


*=i 


u''D^F*u= 


2-W-rt^iDL,yWDL, 


k=] 


u  =  2u^Wu-r'^u^(DL,YWDL,u 


k^\ 


k^\ 


*=1 


2-rZI|i>4 


Jt  =  l 


Therefore,  if  <  — - ,  then 

Eloi.ir 


2-rZI|Di,ir 


A  =  1 


>0  and  w^D^F^m  >0 


*=i 


Hence,  D  F*  is  positive  semidefinite  for  y  small  enough. 


Proof  of  Proposition  3. 7 


First  we'll  show  that  DZ,„  is  a  block  matrix  of  the  form 


DZ;,  =[iio:-:o;-i] 


(3.3.4) 


and 


Dz*  =[oi--:o:-i:i:o;--io]  for  a:  =  i,2,--,f-i. 


(3.3.5) 


19 


NAWCWD  TP  8349 


where  -I  appears  in  the  it-th  block,  I  in  the  (k+l)-st  block,  I  denotes  the  c  x  c  identity 
matrix,  and  there  are  iV  c  x  c  -blocks. 

The  «-th  component  of  i?'"  is  given  by 

(^)  ~  ^l.n  “  ^A'.h  (n  =  l,2,"',C). 


Thus,  the  [n,(i,j)]  -th  entry  of  DI^ ,  denoted  by  (Dl^y  is  given  by 


_ 


0 

0 

-1 

1 


if  i  N 
if  j 

if  i  =  N  and  n  =  j 
if  /  =  1  and  n  =  y 


(1  <  n  <  c,  l<i  <  N,  \<  j  <c). 


(3.3.6) 


The  i-th  c  X  c  -block  of  DLfj  is  denoted  by  ,) 

dL. 


“'Nn 


du^j 


(1  <  «  <  c,  1  <  7  <  c) .  By  Equation  3.3.6,  (DXjy ) 


(l<z<Z\r).Its  (n,7)- entry 
(,  ,)  satisfies 


is 


0  if  /  ^  1, 

^  I  if  /  =  1 
-I  if  /  =  N. 


This  establishes  Equation  3 .3 .4. 

For  1  <  X  <  //  - 1  the  «-th  component  of  X*  :  ->  i?Ms  given  by 
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4,(w)  =  ( «  =  1 ,2  ,  •••  ,c ) . 


Thus,  the  [n, (/,7)]  "th  entry  of  DI* ,  denoted  by  (DZ*  is  given  by 


if  i  ^k,k  +  \ 
li  j^n 

if  i  =  k  and  n  =  j 
if  i  =  k  +  l  and  n  =  j 


(1  < n < c,  \<i<  N,  l<  J  <c). 


(3.3.7) 


The  z-th  c  X  c  -block  of  DZ*  is  denoted  by  (DZ* ),  (,  .)  (1  <  z  ^  A^) .  Its  (n,J)  -  entry  is 
^  L 

— —  (1  <  zz  <  c,  1  <  y  <  c) .  By  Equation  3.3.7,  (DZ^ ). ,, satisfies 

du,: 


(DZ*) 


0  \i  i  ^  k,k  +  \ 
-I  if  z  =  Z  + 1 
-I  if  z  =  k. 


This  establishes  Equation  3.3.5. 

Now,  the  product  (DZ^^  )‘'^W  DLj^  clearly  has  the  form 


■  I  ■ 

0 

W[l  0 

II 

1 

O 

0  •••  0 

0  . 

-w~ 

0 

0 

0  . 

0 

-I 

1 

1 

O 

O 

r  _ 
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and 


0 

•  ••  0! 

1 

0 

0  10  ••• 

1 

1  1  t 

0 

0 

...  o| 

0 

0  jo  ••• 

0 

0 

...  o! 

PF 

o 

1 

0 

0 

...  ol 

_ 1. 

-PF 

PF  1  0  ••• 

0 

o" 

...  0  ! 

1 

:  1 

o' 

0  !0 

1 

:  1  ; 

6 

0 

...  oi 

0 

0  io  ••• 

0 

(l<it<  A^-1), 


where  PF  appears  in  the  (/c,k)-  and  (A: +  1,  A: +  1) -block,  and  -JV  appears  in  the 
(k  +  l,k)-  and  (k,k  + 1)  -block.  Consequently, 


f(DL,)’IVDL, 


2PF 

-PF 

0 

-PF 

2PF 

-PF 

0 

-PF 

2PF 

0 

.  .  . 

0 

-PF 

0 

.  . . 

0  -PF 
0  •••  0 
-PF  i 

0 

-PV  2PF  -PF 
0  -PF  2PF 


J  /Y  _  J  _  I 

Since  PF^A^APF  ^  has  the  same  form,  it  follows  that  yPFDL,  =PF^A^APF\ 

*=i 


Proof  of  Proposition  3.8 
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By  Propositions  3.5  and  3.7  we  can  write  as  =  2-W  . 

So,  as  in  the  proof  of  Proposition  3.6, 


.rrk2 


D^F*u  = 


..  ..T 


2-W -rfV'^A^AfV^  u  =  2u‘  Wu-r-u'W~^A!AW~^u 


=  2 


W~^u\ 


-r 


AW^uW 


iW^u 


-mf 


W^u\ 


2-HiAir 


2 

W~^u 


Since  y  =  j  ,  u^D^F*u  >0  Vu  provided  ||Af  <  4 .  But  ||Af  equals  the  largest 
eigenvalue  of  A^A .  Thus,  the  proof  will  be  complete  once  we  show  that  the  eigenvalues 
of  A^A  are  bounded  by  4. 

The  matrix  A^A  is  a  "block  circulant"  matrix: 


21 

-I 

0 

... 

0 

-I 

-I 

21 

-I 

0 

... 

0 

0 

-I 

21 

-I 

•  ^ 

\ 

1 

•  ^ 

0 

0 

... 

0 

-I 

21 

-I 

-I 

0 

. . . 

0 

-I 

21 

Since  the  blocks  of  A^A  are  multiples  of  the  identity  matrix,  A^A  has  the  same 
eigenvalues  as  the  circulant  matrix 
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2  -1  0  •••  0  -1 
-12-10  •••  0 
0-12-1  i 

:  0 

0  •••  0-12-1 
-1  0  •••  0-12 


which  are  given  by  the  following  expression. 

Fact  3.8.1.  If  is  a  circulant  matrix,  then  the  eigenvalues  of  A  are  given  by  (Reference 

5) 


m  =  \,2,-,N. 


r=l 


Thus,  the  eigenvalues  of  the  matrix  A  above  are  given  by 


X„,  =  2 - e'”-  - c''”"  =  2[1  - cos(2;rf )] ,  m  = 


(3.3.8) 


Since  -1  <  cos(2;7rf-)  <  1  for  all  m,  <4  for  all  m.  Note  that  if  N  is  even,  then 
=4  when  w  =  -f-.  If  N  is  odd  and  m  =  ^,  then  =  2[1 +  cos(-f-)] ->  4  as 
A  00  .  Thus,  the  upper  bound  4  in  general  cannot  be  reduced. 
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4.  THE  2D-MULTICHANNEL  GNC  CASE 


4.1.  DEFINITIONS 


4.1. 


D :  R”"'" 


-» 


R  is  defined  as  D{u)  = 


where 


My/  =  My/.2  •  •  ■  e  i?"  (1  <  /  <  n,  1  <  ;•  <  m) , 


r  7  -  T-  •  T-  T-  T*  •  ,  7’*  ,  7’;  •  ^  T-iT  ^  nwiic 

U  =  *  Wj2  I  ”  *  .  .  ^21  *  ^22  *  * '  ‘  •  ^2/m  •  ‘  *  ^n2  *  *  ’  *  •  J  ^ 


W  =  c/wg-(w,  ,W2,---,wJ  (w,.  >  0) , 


and  the  weighted  norm  ||  ||^  is  defined  as  IHI^  =  • 

/=] 


4.2.  Mfj :  i?'""'  -»  i?*"  is  defined  as  My  (w)  =  w,  -  m,j  for  1  <  /  <  n,  1  <  y  <  w  - 1 

and  M„„(m)  =  w,  i  -  w,  for  1  <  z  <  n  and  u  e  i?"""'  as  defined  in  4.1. 

Ny  :  R”""'  R‘^  is  defined  as  Ny  (w)  =  ^  -  u^  j  for  1  <  z  <  «  - 1, 1  <  y  <  zm 

and  N,yiu)  =  iz, -  u„j  for  1  <  y  <  m  and  iz  e  R'"""  as  defined  in  4.1. 

4.3.  G  :  R"''“'  X  {0,1}"'"  x  {0,1}""'  is  given  by  G(u,a,b)  =  H(u,a)  +  V (u,b) ,  where 


Hiu,a)=  E^A„a.(|Kjy(M)|L 


V(u,b)^ 

]^i<n 


a  — [^lj  ^7)2  ^21  ^22 


a 


2/« 


^/7l  ^//2 
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*  =  [^11  ^12  •  •  ■  K„  ^21  ^22  •  •  •  K„  •  •  •  b„\  K2  ’  •  •  ^,m,V  e  {0,1}”"' ,  U  €  i?""'" 
as  defined  in  4.1.,  and  „  :  R  x  {0,1}  R  is  defined  by 

h;^„{t,b)  =  ^t'^i\-b)  +  ab  (t  eR,b  €{0,1}). 

4.4.  F :  i?"'""  X  {0,1}""' X  {0,1}""' i?  is  given  by  F  =  D  +  G. 

4.5.  G  :  R”""  R  is  given  by  G(u)  =  H{u)  +  V(u),  where 

15/£W  \^j^m 

as  defined  in  4.1.,  and  g^^:R-^R  is  defined  by 


if  l^l  < 

\a  if  \t\>'^A’ 


for  a  >0. 


4.6.  G^  :  R"'“^  ->R  is  defined  as  G  with  and  replaced  by  and 

Sy  Aj  aj »  respectively,  and  gy  x,a  ■  R->  R  is  defined  for  a  >  0  by 

if  |t|  <  q 

grxa (t)  =  <  a- \y{\t\ - rf  if  q<\t\<r  , 
a  if  r<|f| 
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>^>0  and  q  =  ^,  r  =a(-  +  ^). 

2V  /  A 

4.7.  ^  R  is  defined  as  G  with  gx„a,  replaced  by 

g* :  R->  R  defined  by  g"  (t)  =  -^yt^  (t  eR). 

4.8.  F ,  Fj,,  and  F*  :  ->  i?  are  defined,  respectively,  as  F  =  D  +  G, 

F^  =D  +  G^,  and  F*  =D  +  G\ 

4.2.  CONVEXITY  OF  iy  :  ->  R 

Proposition  4.1.  F^  -  F*  :  R'"'"'  ^  is  convex  (proof:  same  as  Corollary  3.4). 
Proposition  4.2.  The  Hessian  satisfies 


'O^F^  =2-W„,„-r 


Y,{1>n,Ywon, 


\^j^m 


\^j^m 


(4.2.1) 


where  the  constant  matrices  DM^  and  UNy  denote,  respectively,  the  total  derivatives  of 
Mjj  and  Ny  (1  <  i  <  «,  1  <  j  <m) ,  =  Block  Diag(JV,fV,'”,W} ,  and 

V - - / 

mn-iimes 

W  =  diag(Wj,w^,"-,-^c)- 

Proposition  4.3.  If  :  R"'""  R"  and  Ny  :  R"”'"  ->•  R‘'  are  given  by  Definition  4.2, 
then 
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J^{DMyYWf>My  =  Jf2 ,  (4.2.a) 


where  Cl  =  Block  Diag(  A„,  ,A,„  and  A,„  is  the  mcxmc  "block  circulant" 

\ - ^ - — - ' 

n-fitnes 

matrix 


■-I  I  0  .  0 

0  -I  I  0  •••  0 


0  .  0  -I  I 

I  0  .  0  -I 


with  blocks  of  size  cxc  . 


X(ON,yWDNi,  =  nd<K-fKL 


where  A„  is  a  "block  circulant"  matrix  of  the  same  form  as  A,„  of  size  nmc  x  nmc  and 
blocks  of  size  me  x  me. 

Proposition  4.4.  If  ->  R"  and  N,j  :  i?'"""  ^  R"  are  given  by  Definition  4.2 

and  y  =  X  >  then  the  Hessian  is  positive  semidefmite.  Thus,  F*  is  convex. 

Corollary  4.1.  If  :  R’"""  and  ;  R"”'"  ^  i?"  are  given  by  Definition  4.2  and 

y  =  X  >  then  is  convex  (proof:  same  as  Corollary  3.6). 
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4.3.  THE  PROOFS 
Proof  of  Proposition  4.2 

Let  Ind  denote  the  set  of  indices  {  (i,j,k)  <n,\<  j  <m,\<k  <c} . 


dPju) 


d 


it  =  l 


=  2w,(m„, 


(r,5,/)  ^Ind 


^D{u) 


0  if  ijk^rst  ..... 

.  ..  ,  {iJ,k), 

2w,  if  ijk  =  rst. 


(r,s,t)  e  Ind . 


Thus,  D^D  is  an  nmcxnmc  block  matrix  with  (nm)^  blocks  of  size  cxc.  All  the 
blocks  are  zero  except  for  the  nm  diagonal  blocks,  which  are  all  equal  to  2‘W.  Thus, 
D^D  =  2-iF  . 

Next,  we  compute  and  D^V*  .  But  H*  has  the  same  form  as  G*  of  the  ID- 

case  (see  Proposition  3.5),  except  that  it  involves  My  and  a  double  sum  (sum  over 

i,j,  \<i<n,\<  j  ^m)  instead  of  and  a  sum  over  k,  l<k<N.  Thus,  has 

the  same  form  as  D^G*  of  the  ID-case,  namely 


=-r  Y^iDMyYWDMy  . 

l£/</J 

]<j<m 


Similarly,  D^V*  =  -y  .  This  establishes  Equation  4.2.1. 

1^/1/; 

lS/<w 
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Proof  of  Proposition  4.3 

The  total  derivatives  DMy  are  matrices  of  dimension  c  x  nmc .  The  columns  of  these 

matrices  are  indexed  by  the  indices  of  the  components  of  the  variable  u  e  ,  namely, 
the  triplets  ir,s,t)  e  Ind  ordered  by  the  rule 


ii,j,k)<{r,s,t)  <=>  i< 

i  = 
i  = 


r. 

or 

r 

and 

J<s, 

or 

r. 

j  =  s. 

and 

k  <t 

Therefore,  these  matrices  (as  well  as  the  matrices  DA^,^.)  naturally  decompose  into  nm 

blocks  of  size  cxc.  These  blocks  can  naturally  be  indexed  by  the  tuples 
{ {i,j) ;  1  <  i  <  n,  1  <  j  ^m)  ordered  by  the  rule 


{i,j)<{r,s)  o  i<r,  or 

i  =  r  and  J  <s. 


Moreover,  since  W  is  a  cxc  matrix,  the  products  (DMyyWDMy  are  nmc  x  nmc 
matrices  that  naturally  decompose  into: 

(a)  {nmf  blocks  of  size  cxc,  or 

(b)  n^  blocks  of  size  mcxmc,  or 

(c)  m^  blocks  of  size  ncxnc . 

This  observation  also  applies  to  the  products  (DNyYWDNy.  In  case  (a),  the  cxc 
blocks  will  be  indexed  by  pairs  of  tuples  ,  \  <i,r  <n,  1  <  j,s  <  m .  In  case 

(b),  the  me  x  me  blocks  will  simply  be  indexed  by  tuples  (/,r) ,  1  <  i,r  <  n .  In  case  (c), 
the  nc  X  nc  blocks  will  be  indexed  by  tuples  {j,s) ,  \<j,s<m. 
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First  we'll  show  that  DM,.,,,  and  DM^.  are  block  matrices  of  the  following  form: 


DM,„,  =[0  •••  0  I  0  -  0  -I  0  -  0],  (l</<w)  (4.3.1) 


where  I  denotes  the  c  x  c  identity  matrix  and  appears  in  the  (/,1)  -  block,  -I  appears  in 
the  {i,m)  •  block,  and  there  are  nm  blocks  of  size  c  x  c .  And 


DM^=[0  •••  0  -I  I  0  -  0],  (l<i<n,  l<7</n-l)  (4.3.2) 


where  -I  appears  in  the  {ij)  -  block,  I  appears  in  the  {i,j  + 1)  -  block,  and  there  are  nm 
blocks  of  size  c  x  c . 

Choose  i  €  {1,  2,  •••,«} .  The  k-th  component  of  M„„ :  i?""'"  R‘  is 


^im,k  (*^)  ~  ^i,\,k  ^i,iii,k 


(l<k<c). 


Thus  the  [A:,(r,^,0]  entry  of  DM,,,,  ,  denoted  by  (DM,.,,, )*  (,.  ,,)  ,  is 


^^inuk 


0  if  r  / 

0  t  ^k 

<  0  if  s^\,m  ,  {r,s,t)  e^lnd ,\<k<c .  (4.3.3) 

1  if  r  =  i,s  =  l,t  =  k 
-1  if  r  =  i,  s  =  m,t  =  k 
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The  (r,s)  -th  cxc  block  of  is  denoted  by  (1  <  r  <  n,  1  <  ^  <  w) . 

^  Ivf 

Its  {k,t)  entry  is  - —  {\<k<c,  1  <  t  <  c) .  By  Equation  4.3.3, 

satisfies 


0  if  r 

0  if  .5  1,  /n 

I  if  r  =  /,  5  =  1 

-I  if  r  =  /,  5  =  m 


(1  <  r  <  n,  \<s<m) . 


This  establishes  Equation  4.3.1. 

Choose  /■  €  {1, 2,  •  •  • ,  n)  and  ;  €  {1, 2,  •  •  • ,  m  - 1}  .  The  k-th  component  of 
M„  :  is 


Mij,k  («)  =  w, j+i.*  -  W/j,*  (1  <  A:  <  c) . 


Thus  the  [A:,(r,5,r)]  entry  of  DMy  ,  denoted  by  (DM^.)*  ,  is 


ii,k 


'  0  if  rjki 

0  if  t  ^  k 

<  0  if  ^  9^7,7 +  1  ,  (r,s,t)  &Ind ,  l<  k  <c.  (4.3.4) 

1  if  r  =  i,s  =  j  +  l,t  =  k 
-1  if  r  =  i,  5  =  j,t  =  k 
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The  (r, j) -th  cxc  block  of  DMy  is  denoted  by  (1  ^ r  < n,  1  <  j: <  w) . 

Its  {k,t)  entry  is - ^  (1  <  A:  <  c,  1  <  /  <  c) .  By  (4.3.4),  (DM  ), .  satisfies 


(DM,) 


0  \i  r 

0  if  5  7,7  +  1 

I  if  r  =  1, 5  =  7  + 1 
-1  if  r  =  i,s  =  j 


(\<r<n,  \<s<m) . 


This  establishes  Equation  4.3.2. 

By  Equation  4.3.1  the  product  (DM,„,)^1F  DM^,,,  has  the  form 


(DM,J^1FDM,„  = 


'0 

•••  0  1 

1 

0 

... 

0  10- 
1 

I  1  * 

•  o' 

0 

...  oi 

0 

... 

0  1  0  • 

•  0 

0 

•  ••  oi 

1 

w 

0  ••• 

0 

o 

— 

1 

•  0 

1 

1 

1 

:  1 

0 

. 

... 

0  ! 

1 

.  1 

1 

1 

1 

0 

. 

. . . 

oi' 

0 

•••  0  j 

-w 

0  ••• 

0 

w  \  o  ■ 

••  0 

0 

...  0  1 

0 

... 

0  jo  • 

1  6 

0 

...  J 

0 

... 

0  !  0  • 

•• 

(1  <  /  <  n) , 


where  W  appears  in  the  ((z,l),(i,l))  block  and  in  the  {{i,rn),{i,m)')  block,  -W  appears  in 
the  ((/,!),(/, m))  block  and  in  the  ((i,m),  (/,!))  block,  and  all  other  blocks  are  zero. 

By  Equation  4.3.2  the  product  (DM,)^1F  DM,  has  the  form 
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0  • 

•  0  1 

1 

;  1 

0 

0 

!  0  • 

1 

1  : 

•  0 

0  • 

•  o| 

0 

0 

io  • 

•  0 

0  ■ 

•  ^  i 

W 

0 

1 

•  0 

0  • 

0 1 

.  ^  ~  -j- 

-W 

_ 

0 

•  0 

0  • 

••  01 

1 

:  1 

0 

0 

!o  • 

1 

1  : 

■•”0 

0  • 

1 

••  0  ! 

0 

0 

io  • 

••  0 

(1  <  i  <  n,  \<  J  <m-\). 


where  )fF  appears  in  the  ((/,/),(/, 7))  block  and  the  ((1,7 +  1), (7,7  +  1))  block,  -W 
appears  in  the  ((/,7  +  l),(i,7))  block  and  the  ((7,7),(i,7  +  l))  block,  and  all  other  blocks 
are  zero. 


’LL. 

0 

0 

Consequently, 

m 

0  i  ii 

v'^  K  ''  0 

M 

_oT' 

0 

_ 1 

ol 

where 


=  Block  Diag(W,W,- ••,!¥) , 

m- times 


'2W 

-w 

0 

... 

0 

-W 

-W 

2W 

-w 

0 

... 

0 

JV^A^A  w'^  = 

m  m  m  tii 

0 

-W 

2W 

-w 

0 

0 

... 

0 

-w 

2W 

-w 

-w 

0 

... 

0 

-W 

2W 

and  appears  in  the  i-th  diagonal  block  of  size  me  xmc  (l<i  <ri);  all  other  blocks  are 
zero.  Summing  these  block  matrices  over  i  leads  to 
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DMy  =  Block  Diag{  WJ  AjA 


IV2 

»i  ''m  5 


\^j^m 


A  ) 

9  m  ni  > 

n- times 


=  •  -S/ocA:  Diagi  A^, A„, ,  •  •  • ,  A^,, A,„  )  * 

V - ^ - / 

n-fimes 

=  iv^  -q^q-WK 

'  '  nni  mil  5 


1 

2 

nm 


which  establishes  Equation  4.2.a. 

Next,  we'll  show  that  DN„j  and  DNy  are  block  matrices  of  the  following  form: 


DA,y.  =[0  •••  0  I  0  •••  0  1  0  •••  0  1  •••10  •••  OlO  •••  0  -I  0  •••  O] 


(\<j<m). 


(4.3.5) 


where  I  denotes  the  c  x  c  identity  matrix  and  appears  in  the  (l,y)  -  block,  -I  appears  in 
the  in,j)  -  block,  all  other  blocks  are  zero,  and  there  are  nm  blocks  of  size  cxc .  And 


DA^..  =[0  •••  010  •••  0  -I  0  •••  0  10  •••  0  I  0  •••  010  •••  O] 


(1  <  /  <  «  - 1  ,  1  <  y  <  m) , 


(4.3.6) 


where  -I  appears  in  the  (i,])-  block,  I  appears  in  the  (/  +  l,y)-  block,  all  other  blocks 
are  zero,  and  there  are  nm  blocks  of  size  cxc. 

Choose  1  <  j  ^m.  The  k-th  component  of  N„j :  — >  i?‘  is 
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^„j,k  («)  =  “i.,/.*  ~  "»./.*  (1  <  A:  <  c)  . 


Thus,  the  [k,(r,s,t)]  entry  of  DN„j  ,  denoted  by 


0  if  s^J 
0  if  t  ^  k 

<  0  if  r  5*  l,n 

1  if  r  =  1,5  =  j,t  =  k 

-1  if  r  =  n,s  =  j,t  =  k 


(r,s,t)  eind ,  \<k<c.  (4.3.7) 


The  (r,5) -th  cxc  block  of  DN,,/  is  denoted  by  (D77„^. (1  <  r  < n,  1  <  5 <  w)  . 

(l<A:<c,  l</<c).  By  Equation  4.3.7,  (DT/,^. 


Its  ik,t)  entry  is 


satisfies 


0  if  5  y 
0  if  r  5^  l,n 
I  if  r  =  i,5  =  y 
-I  if  r  =  n,5  =  j 


(1  <  r  <  n,  1  <  5  <  w)  . 


This  establishes  Equation  4.3.5. 


Choose  1  <  y  <  m  and  /  €  {1, 2,  •  •  • ,  n  - 1} .  The  k-th  component  of  Ny  :  i?"""'  ^  R"  is 


=  ^MJ,k 


—  U: 


'J,k 


(\<k<c). 
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Thus,  the  [A:,(r,5,t)]  entry  of  DNy  ,  denoted  by  ,  is 

0  \f  j 
dN  ^  if  t  ^  k 

{DNy  )*(,,,)  =  — ^  =  <  0  if  r  ^  /,/  + 1  {r^s,t)  eind,  \<k<c.  (4.3.8) 

1  if  r  =  i  + 1,5  =  7, r  =  A: 

-1  if  r  =  i,s  =  j,t  =  k 

The  {r,s)  -th  cxc  block  of  DA^,^.  is  denoted  by  {DNy),^^„^^  {l<r  <n,  1  <  5  <  w) .  Its 

^^iik 

{k,t)  entry  is  - —  {\<k<c,  1  <  t  <  c) .  By  Equation  4.3.8,  (D7/„), ,  satisfies 

0  if  j 

0  if  r  i,i  + 1 

(DA^j/)*.(r..v..)  =i  .  ..  .^1  (!</•<«,  l<5<m). 

■'  ’  I  n  r  =  i  +  \,s  =  j 

-I  if  r  =  1,5  =  7 

This  establishes  Equation  4.3.6. 

By  Equation  4.3.5  the  product  {J}N,yYW  DN^j  has  the  form 
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‘0 

... 

o 

o 

o 

o 

. . . 

0 

1 

1 

1 

1 

1 

1 

0 

w 

1 

1 

1 

1 

1 

1 

-w 

0 

1 

1 

1 

1 

1 

1 

1 

0 

0 

... 

o 

o 

0  i 

... 

0 

... 

0  i  0 

1  0 

1 

1 

. . . 

0 

. . . 

oi 

1 

1 

0  1  0 

1 

... 

0 

... 

0  1  0 

1 

1 

0 !  0 

1 

1 

. . . 

0 

1 

1 

1 

1 

1 

1 

1 

0 

-w 

i 

1 

1 

1 

1 

w 

0 

1 

1 

1 

1 

1 

1 

1 

0 

_0 

... 

0 !  0 

1 

0 !  0 

... 

0 

0 

0 

0 


where  JV  appears  in  the  ((l,y),(l,y))  block  and  in  the  (in,j),{n,j))  block,  -W 
appears  in  the  {{\,j),{nJ))  block  and  in  the  ((«,y),(l,y))  block,  and  all  other  blocks 
are  zero.  Consequently, 


X(DW„)'>DW,, 

./=1 


1^' 

! _ 

1  0 

o 

— 

1 

! _ 1 

•  o 

1  0 

I 

1 

-  0! 

I 

1 

..  o 

o  • 

1 

.10__ 

o 

— 

o  • 

1 

_ 1 

1  0 

1 

...  o! 

w 

m  J 
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where  the  size  of  the  blocks  is  mcxmc,  =  Block  Diag{W,W,"-,W)  appears  in  the 

'  V  ^ 

m- times 

(1,1)  block  and  in  the  {n,n)  block,  appears  in  the  (1,«)  block  and  in  the  (n,l) 
block,  and  all  other  blocks  are  zero. 

By  Equation  4.3.6,  the  product  (DNy^WDNy  has  the  form 


(1  <  i  <  n  - 1,  l<  J  <m) , 
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where  appears  in  the  ((/,/), O’, 7))  block  and  the  (O  +  UyXO  +  lsy))  block,  -JV 
appears  in  the  ((i,j),(i  +  l,j))  block  and  the  (0  + 1,7 XO,/))  block,  and  all  other  blocks 
are  zero.  Consequently, 


■£(ON,yH'DN,  = 

7=1 


- 1 

•  0 

•  0  1 

1 

\  1 

0 

0 

I  0  • 

1 

1  : 

I - 

0  •• 

0  • 

0 

0 

0 

* 

0 

•  0  1 

1 

w 

'  m 

-W 

^  m 

1  0  • 

1 

••  0 

0  • 

•  0  1 
1- 

-W 

^  m 

w 

m 

1  0  • 
_J _ 

••  0 

0  ■ 

•  0  1 

1 

:  I 

0 

10  • 

1 

1  : 

••  0 

1 - 

0  • 

■■  oi 

0 

0 

|o  • 

-  o_ 

(l<i<n-l), 


where  tlie  size  of  the  blocks  is  mcxmc,  W„,  appears  in  the  0,0  block  and  in  the 
0  +  l,/  +  l)  block,  appears  in  the  0,^  +  0  block  and  in  the  0  + 1>0  block,  and  all 
other  blocks  are  zero.  Summing  these  block  matrices  over  i  leads  to 


CN 

1 _ 

-w 

in 

0 

... 

0 

-W 

'  in 

-w 

m 

2W 

-W 

in 

0 

. . . 

0 

0 

-W 

2W... 

-K. 

• 

in 

in 

m 

0 

* 

* 

* 

• 

■ 

\^j^m 

0 

... 

0 

-w 

III 

iW 

^  in 

-w 

''in 

-w 

L  n* 

0 

... 

0 

-w 

in 

2W 

m 

which  establishes  Equation  4.3.b. 

Proof  of  Proposition  4.4 

By  Propositions  4.2  and  4.3,  =  2  •  W„„,  -  y  •  W„l,  •  [Q^Q  +  A^,A„ ]  •  W„l  . 
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Thus,  as  in  the  proof  of  Proposition  3.8, 


u 


'^D^F*u  =  2-u‘'W., 


u-y-  u^W  ^ 


•[q’ 


Q  +  A>„ 


, 

2 

, 

2 

—  •  2“] 

2- 

W~^  u 

'  imi 

-r- 

QJV^  u 

nm 

+ 

A  U 

^^n  ^'^nm  ^ 

>2' 


u 

wu 


-r 


nr+  A 


^  r]'||  " 


2-y.(||nf +||A,f ) 


W'^  u 

^  nm 


Since  y  =  }^,  u^\i^F*u>Q  for  all  ueR""'‘'  provided  ||  Q  ||^ +||  A„  ||^  <8.  But 
I  Q  1^  and  ||  A„  |p  equal  the  largest  eigenvalue  of  and  Ay,A„,  respectively. 

These  eigenvalues  are  bounded  by  4  by  Fact  3.8.1,  Equation  3.3.8,  eind  the  fact  that  A„ 
has  the  same  form  as  A  and  Q  is  a  block  diagonal  matrix  with  diagonal  blocks  equal 
to  A,„,  which  has  the  same  form  as  A .  Therefore,  u^D^F*u  >  0  for  all  u  €  i?"""" 
and  F'^  is  convex. 
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